$ sudo apt-get update
$ sudo apt-get install libxmu-headers 

libxmu-headers is installed in your system.

Make ensure the libxmu-headers package were installed using the commands given below,

$ sudo dpkg-query -l | grep libxmu-headers *

You will get with libxmu-headers package name, version, architecture and description in a table

libxmu-headers package basic information: